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FORMAL GROUPS AND Z-ENTROPIES 


PIERGIULIO TEMPESTA 


Abstract. We shall prove that the celebrated Renyi entropy is the first exam¬ 
ple of a new family of infinitely many multi-parametric entropies. We shall call 
them the Z-entropies. Each of them, under suitable hypotheses, generalizes 
the celebrated entropies of Boltzmann and Renyi. 

A crucial aspect is that every Z-entropy is composable [l]. This property 
means that the entropy of a system which is composed of two or more inde¬ 
pendent systems depends, in all the associated probability space, on the choice 
of the two systems only. Further properties are also required, to describe the 
composition process in terms of a group law. 

The composability axiom, introduced as a generalization of the fourth 
Shannon-Khinchin axiom (postulating additivity), is a highly non-trivial re¬ 
quirement. Indeed, in the trace-form class, the Boltzmann entropy and Tsallis 
entropy are the only known composable cases. However, in the non-trace form 
class, the Z-entropies arise as new entropic functions possessing the mathe¬ 
matical properties necessary for information-theoretical applications, in both 
classical and quantum contexts. 

From a mathematical point of view, composability is intimately related to 
formal group theory of algebraic topology. The underlying group-theoretical 
structure determines crucially the statistical properties of the corresponding 
entropies. 
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9. The Z a b-entropy: A generalization of the Boltzmann, Tsallis 


1. Introduction 

Since the pioneering work by Boltzmann, Clausius and Gibbs, the notion of 
entropy has been widely investigated for its prominence in thermodynamics and 
statistical mechanics, in both classical and quantum contexts m-m • The research 
activity inaugurated by Shannon, Khinchin and Renyi recognized the foundational 
role of entropy in modern information theory m-M- In particular, new entropic 
functions, designed for different purposes, have been introduced (see e.g. [10]). 

The purpose of this paper is to show that the theory of generalized entropies 
can be mathematically interpreted, and widely extended, by means of an approach 
based on formal group theory [12j . Since the seminal paper by Bochner m, formal 
groups have been intensively investigated in the last decades, because they play 
a prominent role in several branches of mathematics, especially algebraic topol¬ 
ogy m-m, combinatorics Hz], the theory of elliptic curves [18] , arithmetic and 
analytic number theory [T$]-d251. 

In order to relate the notion of entropy to group theory, we shall discuss the 
mathematical requirements that an entropic function has to satisfy. A natural set 
of conditions is represented by the first three Shannon-Khinchin (SK) axioms (see 
appendix A for their formulation). These axioms correspond to the requirements 
of continuity, expansibility (adding an event of zero probability does not affect an 
entropy) and of the maximization of entropy on the uniform distribution. 

At the same time, another crucial property that, in our opinion, any entropy 
must satisfy is that of composability [T.. Essentially, it requires that the entropy of 
a system obtained by composing two independent systems A and B can always be 
expressed in terms of the entropies of A and of B only, for any possible choice of 
the probability distributions of A and B. 

This property is at the heart of the notion of entropy. Indeed, it is related to the 
requirement, pointed out in |24], that entropy is usefully defined on macroscopic 
states of a given system, without the need for any knowledge of the underlying 
microscopical dynamics. 

As clarified in |Tj, composability is even more demanding: we should be able to 
compose two independent systems in a commutative way, and three independent 
systems in an associative way. Also, if we compose a system with another one in 
a zero-entropy configuration, the entropy of the compound system should be equal 
to the entropy of the first system. In other words, a group-theoretical structure 
is needed. All these requirements were encoded in [1] in the composability axiom. 
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It generalizes the fourth Shannon-Khinchin axiom (additivity of an entropy) and 
allows a large family of entropic functions to be constructed. 

Concerning the mathematical form that generalized entropies can assume, we 
distinguish two different classes. 

The first one is the trace-form class. It contains entropies of the form Xuli F(Pi)i 
where {pijigN is a probability distribution and F(pi) is a suitable function. The 

standard case of the Boltzmann-Gibbs entropy is recovered when F(jpi) = p t In j . 
In the last three decades, this family of entropic functions has been widely investi¬ 
gated, due to its relevance in the theory of complex systems. 

The second one is the class of non-trace-form entropies. The most well-known 
representative is the Renyi entropy S a = - v ‘ , a > 0. It was introduced in [8] 
and has inspired much work in information theory. Its quantum version is crucial 
in the study of entanglement of quantum complex systems. 

A huge part of the set of entropies introduced in the last three decades, per¬ 
haps because of the influence of the classical Boltzmann entropy, belongs to the 
trace-form class. Also, these new entropies are supposed to recover Boltzmann’s 
entropy in some appropriate limit. Nevertheless, the trace-form class has a serious 
drawback: the generic lack of composability, with the two remarkable exceptions 
of the Boltzmann entropy and the Tsallis entropy (which in this paper we present 
in a two-paranretric form). 

However, many generalized trace-form entropies are composable in a weak sense 
only, i.e. over the uniform probability distribution. This feature of weak compos- 
ability is certainly necessary for thermodynamic purposes, but its lack of generality 
makes it unsatisfactory. However, one of the outcomes of our analysis is that by 
renouncing the trace-form structure we can define new composable entropies. To 
summarize, the most relevant result of this work is the following. 

Main result. There exists a new family of non-trace-form strictly composable 
entropies. 

Precisely, we shall prove that the celebrated Renyi entropy is the simplest rep¬ 
resentative of a huge family of entropies that we shall call the Z-entropies. Each 
of them depends on a real parameter a and possesses a group structure. Indeed, 
to each entropy there is associated a suitable invertible function G, allowing un¬ 
der certain hypotheses a formal group law to be defined [12] . i.e. a two-variable 
series determined by the relation T(a :,y) = G(G~ 1 (x ) + G~ 1 (y)) which satisfies 
the axioms of an Abelian group. The group law is nothing but the functional 
equation obeyed by the considered Z-entropy under the composition of two statis¬ 
tically independent systems. In this framework, the Renyi entropy has associated 
the function 'f>(x,y) = x + y 1 obtained when G = Id, i.e. the additive group law. 
The corresponding functional equation is S a (A U B) = S a (A) + S a (B), for any 
couple of independent subsystems A, B. This construction enables us to formulate 
the whole theory of generalized entropies into a firm foundational group-theoretical 
framework. 

A very general expression of the non-trace-form family of group entropies is (see 
Definition [8] below) 



(1) 


Zg,cx(p 1 , • • • ,Pw) : 


1 — a 
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where Inc (a;) is a generalized logarithm and a > 0 is a real parameter. When 
0 < a < 1, the Za, a entropy is concave; when a > 1, under mild hypotheses it 
is Schur concave. Throughout this paper, we shall assume that the Boltzmann 
constant fcg = 1 . 

A fundamental property of the Z-entropies 0 is that, under suitable hypotheses, 
they generalize, at the same time, the entropies of Boltzmann and Renyi in a 
unified expression. In a specific example, the Tsallis entropy (jointly with those of 
Boltzmann and Renyi) is also recovered. 

By choosing adequately the generalized group logarithm in eq. 0 , we can also 
define strictly composable analogues of well known entropies, including those of 
Kaniadakis, Borges-Roditi, etc. None of them is indeed composable. 

In the trace-form case, the group-theoretical approach to the concept of entropy 
has been already formulated in [I]. There, the notion of universal-group entropy , 
as the entropy related to the Lazard universal formal group, has been introduced. 

From the previous considerations, it emerges that there exists a dual construction 
among the two classes of entropies. Precisely, each group law admits (at least) two 
realizations in terms of two different entropic forms, belonging to the two classes 
Zg,o\p] and Sjj[p], respectively. 

The additive group has two representatives: the Boltzmann entropy and the 
Renyi entropy. The multiplicative group T(x,y) = x + y + 'yxy , where 7 £ 1, 
has interesting realizations, as the Tsallis entropy in the trace-form case, and the 
entropy (12611 in the non-trace-form family. 

There are several reasons to introduce the class of Z-entropies. A first motivation 
comes from the need to establish a mathematically unifying approach to the theory 
of generalized entropies. From this point of view, the group entropies , namely 
entropies satisfying the first three SK axioms and possessing a group-theoretical 
structure ensuring the validity of the composition process over all possible states, 
seem to possess a special role. From a mathematical point of view, each group 
entropy of the Z- class satisfies two crucial properties: strict composability and 
extensivity. Indeed, one can show that under mild conditions, for a given phase 
space growth rate W = W{N), there exists a specific entropy of the Z-class such 
that, over the uniform distribution, limjv _ >00 S(N)/N = A > 0. A priori this allows, 
at least formally, one to develop (in a micro-canonical picture) a formalism similar 
to the classical one for ergodic systems. However, the purpose of this work is not 
to develop thermodynamics. The full clarification of the possible thermodynamic 
meaning of the class of group entropies (as already pointed out in in, m, d) ^ 
an open problem. 

Another reason comes from the study of quantum entanglement. Indeed, quan¬ 
tum versions of Z-entropies (briefly discussed in this work) could be very useful 
in the detection of entanglement for quantum complex systems, as spin chains. 
An example is proposed where a Z-entropy can be used, instead of the quantum 
Renyi entropy, as a measure of the ground state entanglement for a generalized 
Lipkin-Meshkov-Glick model that was recently introduced [27] . In particular, this 
new quantum entropy is extensive (i.e. proportional to L) in a context when the 
entropy of Renyi is not. 

At the same time, the Zc, a entropies are possibly relevant in information the¬ 
ory. Indeed, they widely generalize both the classical a-divergences and the Renyi 
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divergences. One can also expect that zf-entropies could play an important role in 
information geometry. 

To conclude, a few words concerning the organization of the article. In section 2, 
the group-theoretical apparatus necessary for the subsequent discussion is sketched. 
In section 3, we formulate the composability axiom. In section 4, generalized log¬ 
arithms are derived from group laws. In section 5, we discuss properties of the 
trace-form class and more specifically of Tsallis entropy, which is the most general 
composable trace-form entropy. The new family of Z-entropies is defined in section 
6 and some of its properties are proved in section 7. In section 8 , some represen¬ 
tatives of the Z-family are discussed in detail. In particular, the relevant example 
of the Z a ,b-entropy is presented in section 9. A quantum version of the Z-class is 
proposed in section 10. Some open problems are proposed in the final section 11. 


2. Groups and entropies: a general approach 


In the subsequent Sections, we shall present a comprehensive theory of general¬ 
ized entropies based on formal group laws. We will start by recalling some basic 
facts and definitions of the theory of formal groups (see [ 12 ] for a thorough exposi¬ 
tion, and [28] for a shorter introduction). 

2.1. The Lazard formal group. Let R be a commutative associative ring with 
identity, and R{x i, X2,..} be the ring of formal power series in the variables Xi, 
X 2 , with coefficients in R. 

Definition 1 . A commutative one-dimensional formal group law over R is a formal 
power series 4' (x, y) £ R {x, y} such that [IT[ 


1 ) (x, 0 ) = ( 0 , x) = x, 

2 ) f (x,y) ,z) = 't> (y,z)). 


When d* ( x,y) = T (y,x), the formal group law is said to he commutative. 

The existence of an inverse formal series oj (x) £ l?{x} such that 4^ (x, w (x)) = 
0 is a consequence of Definition [I] Let B = Z[ 6 i, 62 ,...] be the ring of integral 
polynomials in infinitely many variables. We shall consider the series 



with b 0 = 1. Let G (t) be its compositional inverse: 



i.e. F (G (t)) = t. From this property, we deduce ao = l,Oi = — 61,02 = § 6 ? — 
62 ,.... The Lazard formal group law |12j is defined by the formal power series 



and generate over Z a subring L C B ® Q, called the Lazard ring. 

For any commutative one-dimensional formal group law over any ring R , there 
exists a unique homomorphism L -A R under which the Lazard group law is mapped 
into the given group law (the universal property of the Lazard group). 
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Let R be a ring with no torsion 0. Then, for any commutative one-dimensional 
formal group law ^(a :,y) over R , there exists a series if(x) € i?[[x]] (8 Q such that 

ip{x) = x + 0(x 2 ), and 'll (a;, y) = if -1 (ip(x) + if(y)) G R[[x, y]] 8 Q. 

In the subsequent considerations, the universal formal group will play the role 
of a very general composition law admissible for the construction of the entropies 
of the Z-family. 


3. The Composability Axiom 

In this section we shall first define the notion of composability, in the strict and 
weak sense, by following (and slightly generalizing) [Tj. 

Definition 2. A n entropy S is strictly (or strongly) composable if there exists a 
continuous function of two real variables $>(x,y) such that 
(Cl) 

(4) S(AUB) = <f>(S(A),S(By,{rj}) 

where A and B are two statistically independent systems, defined for any probability 
distribution {r]} is a possible set of real continuous parameters, with the 

further properties 
(C2) Symmetry: 

(5) $( x , y ) = ${ y , x ). 

(C3) Associativity: 

(6) $(x, ${y,z)) = ${${x,y),z). 

(C4) Null-composability: 

(7) $(x,0)=x. 

This axiom is necessary to ensure that a given entropy may be suitable for 
thermodynamic purposes. Indeed, it should be obviously symmetric with respect 
to the exchange of the labels A and B. At the same time, if we compose a given 
system with another system in a state with zero entropy, the total entropy should 
coincide with that of the given system. Finally, the composability of more than two 
independent systems in an associative way is crucial to define a zeroth law. 

Definition 3. A group entropy is a function S(pi,... ,Pw) R + U {0} that 
satisfies the first three SK axioms and is strictly composable. 

Remark 1. Observe that in the class of formal power series, the function <f>(x,y), 
satisfying the conditions dU)-©, according to Definition |T] is a formal group law 
over the reals, with a suitable formal series inverse <p(x) such that ^(x, <p(x)) = 0 
[121 . The general form of this group law is $(x, y) = x + y + c kix k y l . 

Other properties of < f > (x, y) can be found in pQ, where the notion of weak composabil¬ 
ity was also proposed. The weak formulation essentially requires the composability 
of the generalized logarithm associated with a given entropy. The weak property 
is satisfied by almost all of the generalized entropies proposed in the literature. 
However, it is not obvious: Indeed, there are entropic forms that satisfy the first 
three SK axioms, but are not weakly composable. 


lr The torsion-free hypothesis was implicit also in [l] and m- 
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In [25], this notion (called there “composability” tout court ) has been formulated 
for a class of entropic functions coming from difference operators. 

4. Generalized logarithms and exponentials from group laws 

There is a simple construction allowing a generalized logarithm from a given 
group law to be defined. Needless to say, many other definitions of generalized 
logarithm can be proposed. The following one is of a group-theoretical nature. 

Definition 4. A generalized group logarithm is a continuous, strictly increasing and 
strictly concave function ln G : (0, oo) —> K, with ln G (l) = 0 (possibly depending on 
a set of real parameters); the functional equation 

(8) In G (xy) = x(ln G (x),ln G (y)) 
will be called the group law associated with ln G (-). 

Observe that the eq. flHJ has a simple realization 

(9) X{x,y) ■= G(G _1 (x) +G~ 1 (y)), 

being G{x) := ln G (ea;p(a;)) a strictly increasing continuous function, vanishing at 
zero. 

One of our key results is the following simple proposition, which is a restatement 
of the previous observation. 

Proposition 1. Let G be a continuous strictly increasing function vanishing at 
zero. The function F G {x) defined by 

(10) Fq(x) := G (In a; 7 ), 7 ^0 

satisfies eq. ©. where x(a;,y) is the group law ©. 

Proof. It suffices to observe that 

(11) F G (xy) = G(lnx^+\nyi)=G(G- 1 (F G (x)) + G- 1 (F G (y))) 

= x(FG{x),F G (y)). 

□ 

This result can also be formulated in a field of characteristic zero for G in the 
class of formal power series. 

By way of an example, when x( x - y) = x + Vi we have directly that G{t) = t and 
ln G (x) = lnx. If x{x,y) = x + y+(l — q)xy, an associated function G(t ) is provided 
by G(t) = e( and the group logarithm converts into the Tsallis logarithm 

7*1 — 9 — 1 

(12) In,(a;) := - T ~ 

Remark 2. Let G be a strictly increasing real analytic function of the form ©. 
For ln G (a:) = G(lnx), the requirement of concavity is guaranteed, for instance, by 
the simple (but quite restrictive) condition 

(13) ak > (k + l)afe+i Vk € N, with {afc}fc e w > 0, 

which is also sufficient to ensure that the series G(t) is convergent absolutely and 
uniformly over the compacts with a radius r = oo. Many other choices are allowed. 
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Thus, given a group law, under mild hypotheses we may determine a generalized 
group logarithm, for instance by means of relation (11011 and the condition m 
(see [251 for a construction of group logarithms from difference operators via the 
associated group exponential G). 

Definition 5. The inverse of a generalized group logarithm will be called the asso¬ 
ciated generalized group exponential. 

This function can be represented in the form 

(14) expc{x) = e G 

When G(t) = t, we have returned to the standard exponential; when G(t) = 
e we recover the ^-exponential e q (x) = [1 + (1 — qjt} 1 ^* , and so on. 

Remark 3. From a computational point of view, observe that the formal com¬ 
positional inverse G _1 (s), such that G(G _1 (s)) = s and G _1 (G(f)) = t, can be 
obtained by means of the Lagrange inversion theorem. We get the formal power 
series 

(15) G _1 (s) = s-ys 2 + .... 

Also, given ^(x, y), by imposing the relation iff (a;, y) = G (G _1 (x) + G~ 1 (y )), with 
A>{x,y) = x + y + higher order terms, we get a system of equations that usually 
allows us to reconstruct the sequence {afc}fc g Fj. Each element ak a priori depends 
on the set of parameters appearing in 'Sf{x,y). 


5. On the trace-form class of entropies 

5.1. Basic Properties. Let us denote by N the number of particles of a complex 
system. 

Definition 6. An entropic function S (pi,... ,pw) Is said to be extensive over the 
uniform distribution if there exists a function (“growth rate” or “occupation law” 
of phase space) W = W(N) such that 

lim S(N)/N = A . 

N—> oo 

Here A may depend on thermodynamic variables but not on N. 

Definition 7. An entropy S belongs to the trace-form class if it can be written in 
the form 5[p] = F(Pi)> where F is a real continuous function, strictly concave, 

with F( 0) = F(l) =0 and F ([0,1]) Cl+U {0}. 

5.2. A general logarithm for a composable entropy. The equation for the 
multiplicative formal group allows us to give a two-paranretric preentation of the 
logarithm m ■ Indeed, we observe that the functional equation 

f(x + y) = f { x ) + f{y) + (1 - q)f{x)f{y) 

< 7 ^ 1 , admits the solution 

e a(i-q) x _ i 


fix) = 


1 -q 


This is coherent with the general theory of functional equations [29). From this 
observation, we can also formulate a two-parametric presentation of the Tsallis 
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entropy S q , physically equivalent to it, whose main interest in this context is that 
it is still strictly composable. To this aim, we consider the function defined by 

_ ^a(<j—1) + 1 

(16) -S',, ,, := 


w 

E 




1 \ W CL( 


q~ 1 


for a > 0, q £ R/{1}, with the condition a(q — 1) + 1 > 0. Needless to say, the 
previous constraints in the space of parameters ensure that the entropy S a ^ q satisfies 
the first three SK axioms for all real values of q and specific values of the parameter 
a (for a = 1, <7 —> 1 we recover the Boltzmann entropy). Note that the entropies 
S a , q and S q are related by means of the simple formulae 

S a ,q = aS q /, q'= a(q - 1) + 1 . 

A direct analysis allows us to establish the following result. 


Proposition 2. 

i) 

a) 


The entropy (ED is concave in the regions: 

q £ (— 00 , 1 ), 0 < a < - - 

1 - g 

q £ ( 1 , oo), a > 0 . 


It is easy to show that the entropy S a , q is extensive (on equal probabilities) for 
W ( N ) ~ N p . Indeed, the value q* = 1— ^ is found such that limjv-^oo Sa,q{N)/N = 
A, in a suitable range of a, for values of p > 1. 

One also obtains the following interesting property. 


Proposition 3. Let A and B be two independent systems. The entropy S a , q is 
strictly composable, with composition law given by 

Sa,q(A U B)= Sa,q{A) + Sa,q{B) + (1 - q)Sa, q {A)Sa, q (B). 

The entropy S a ^ q represents the general solution of the previous functional equa¬ 
tion in the trace-form class. 

Comment. It is interesting to observe that the Landsberg-Vedral entropy [30] 
Slv = also called the normalized Tsallis entropy, satisfies the law S LV (A U 

B) = S LV (A) + S LV (B) + {q — 1 )S LV (A)S LV (B). This entropy, therefore, belongs 
to the family of composable entropies. However, it is not of trace-form type. 

A fundamental property of the trace-form class is the following. 

Remark 4. The Tsallis entropy (with the Boltzmann entropy as its reduction) is 
the only known entropy of the trace-form class which is strictly composable. 


6. New strictly composable entropies 

6.1. The Z-family. If we restrict ourselves to the trace-form class, composability 
is realized essentially in the case of the Tsallis entropy, with the Boltzmann entropy 
as its fundamental reduction. 

However, if we relax the trace-form requirement, new possibilities arise. Indeed, 
Renyi’s entropy R a does not have a trace-form structure, and is strictly composable 
(additive). Thus, we shall introduce a new family of group entropies, depending on 
an entropic parameter a , that do not belong to the trace-form class and generalize 
the Renyi entropy. 
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Remark 5. In the following, we shall often assume for simplicity the hypothesis 
of generalized group logarithms of the form Inc (a;) = G(ln;r), with G a strictly 
increasing analytic function of the form ([3]), where at are parameters which can 
vanish; we always assume that they are independent of the entropic parameter a. 

Definition 8. Let {Pi}i—i,... t w, W > 1, with JT =1 Pi = 1, be a discrete probability 
distribution. Let ln <3 be a generalized group logarithm, according to Definition [7J 
The associated Z-entropy of order a is defined to be the function 


(17) 


ZG,a(Pl,- ■ ■ iPW) 



with a>0, a/1. 


The following theorem establishes one of the most relevant properties of the Z-class 
of entropies: its strict composability. 


Theorem 1. The Zc^a-entropy is strictly composable: given any two statisti¬ 
cally independent systems A, B, defined on an arbitrary probability distribution 
{Pi}i=i,- - ,w, it satisfies the composition rule 


(18) ZgAA U B) = $(Z G , a (A),ZG, a ( B )) 

where 

V) = ■ X ((1 - a)x, (1 - a)y) 

1 — a 

with x (x, y ) being the group law satisfied by the generalized group logarithm Inc 
associated to Z G ,a. 


Proof. Let {pf}^ and {pf}f = 1® be two sets of probabilities associated with two 
statistically independent systems A and B. The joint probability is given by pd. UB = 
pf-p B . We have 


Zg,o(A\JB) = 


in G (E t ,M UB ) a ) _ ln G {(yZ a My) ■ (ES(pf) £ 


$ 


1 — a 1 — a 

(in G (zZiipfr) ,i» G (e5 b i (pfr)) 

1 — a 

$((1 - g)Z G , a (A), (1 - a)Zg, a (B)) 

1 — a 

*(Z Gia {A),Z Gia (B)). 


(19) 


Let us prove that the Zc^-class is strictly composable. It suffices to show that 
>I>(a;, y) is a group law, as a consequence of the fact that \ ( x i y) is. The symmetry 
property is trivial. The null-composability comes from the relation 

1 

l — o 


$(x,0) 


X((l - a)x,0) = x. 
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To prove associativity, observe that 
1 




1 — a 

1 

1 — a 

1 

1 — a 


X 


1 


(1 - a)--x ((! - a)x , (1 - a)y) , (1 - a)z 


1 — a' 

x [(1 - a)x, X ((1 - a)y, (1 - a)z)] = 

X [(1 - a)x, (1 - a)<h (y, z)\ = $(x, $(y, z)). 


Consequently, the Zc, a entropies are strictly composable. 


□ 


6.2. Renyi entropy. The celebrated Renyi entropy R a = 11 U'Af p ' is the first 
example in the Z-class. It is obtained by identifying the generalized logarithm with 
the standard one. Renyi’s entropy is indeed the first representative of an infinite 
tower of entropies, that we shall construct in the following sections. It corresponds 
to a solution to the functional equation Zc, a (A U B) = Zc, a (A) ZG, a (B). 


7. Main properties of the class of Z-entropies 


7.1. Limiting properties. The class of Z-entropies possesses a simple relation to 
the most celebrated entropies, in particular to Boltzmann’s and Renyi’s entropies, 
as stated by the following results. 

Proposition 4. Under the hypotheses of Remark 5, in the limit a -A 1, the ZQ a - 
entropy reduces to the Boltzmann-Gibbs entropy. 


Proof. 


1 *g(zZi Pf) G 

lim -—--— = lim — 

a—1 — CX a—>-1 


In 


{zZi p?) 


1 — a 


G' 


= lim ■ 

a.— >1 


In 


(TZ iPf) 


■ T,Zl Pi ln Pi Z' 1 

-= > Pi In—. 

“ Pi 


v - ' W a 

p? 


-1 


where we took into account the fact that G'(0) = 1. 


□ 


Proposition 5. Under the hypotheses of Remark 5, the Zc^a-entropy generalizes 
the Renyi entropy. 

Proof. It suffices to observe that the function lnc(x) reduces to In a; when ai —>■ 0, 
i = 1,2,..., in the expression J3J of G[t). □ 

A crucial property of the Z-class is that it is compatible with the SK require¬ 
ments, as made clear by the following statement. 


7.2. The SK axioms. 

Theorem 2. The Zc, a -entropy satisfies the first three SK axioms, for 0 < a < 1. 

Proof. We shall check the validity of the axioms in the formulation given in the 
appendix. 

(SKI). By construction, the function ([1]) is continuous with respect to all of its 
arguments pt. 
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(SK2). The entropy JH is strictly concave for 0 < a < 1. Indeed, given two 
probability distributions ... ,Py)) and p( 2 ) = (p[ 2 , ■ ■ ■ ,Pw ), we have 


Za , a (APi + (1 - A)p 2 ) = 


> 


ln G (Efei ( A ^ 1} + (! - X )Pi 
1 — a 


in G (\zZM 1) ) a + (i -e Etiip^r) 


( 2 ) 


> 


> A 


Inc (YZ^Y 


1 — a 


+ (1-A) 


> 


Inc; (yZM?Y) 


1 — a 1 — a 

where we took into account that Inc is by construction strictly concave and in- 


creasing, and that the function E;=i P? i s concave for 0 < a < 1. 
(SK3). By adding an event of zero pr 

(20) Za,a(pi, ■ ■ ■ ,Pw, 0 = pw+i) = 


(SK3). By adding an event of zero probability, for a > 0, a ^ 1 we have 

ln G (ES 1 P?) Inc (E*=i P?) 


1 — a 


1 — a 


□ 


We conclude that the Z-entropies are group entropies. 

7.3. Extensivity. We shall discuss the extensivity properties of the Z-family of 
entropies over the uniform probability distribution (i.e. pi = 1 /W for all i = 
1,..., W). In other words, we wish to determine the conditions ensuring that a 
Z-entropy is proportional to the number N of particles of a given system, in the 
large N limit, when all states are equiprobable. We have that, for N large (and 
focusing on the leading constribution to the asymptotic behaviour) 

Z G , a [W]~\N <{=> \nc{W l ~ a ) ~ (1 — a)XN 
(21) W(N) ~ [exp G ((1 - a)AA7)] 1/(1_ “ } . 

The expression for W(N) so determined usually can be computed explicitly. 

However, the function W(N) must be interpretable as a phase space growth rate. 
A sufficient condition is that W(N) be defined for all N £ N as a real function, 
with lim 7 v->oo W (N) = oo. These requirements usually restrict the space of allowed 
parameters of the considered entropy. 

Consequently, provided the previous condition is satisfied, the entropies of the 
Z-family are extensive on a specific regime, given by a growth rate W(N). 

The previous properties altogether indicate the potential relevance of the notion 
of Z-entropy in thermodynamical contexts and, more generally, in the theory of 
complex systems. 

7.4. The Schur concavity of Z-entropies. In Theorem [2] we have assumed 
0 < a < 1 to guarantee concavity of the Z-family. However, if we take a > 1, under 
mild hypotheses this family satisfies the interesting property of Schur concavity. 
We recall here some basic facts about majorization [3T]. A vector a £ K™ majorizes 
or dominates another vector b £ K" (and we write a ^ b) if the following properties 








GROUPS AND ENTROPIES 


13 


are satisfied: 


k k 

(22) i) '^ j a i >'^b i , k = l,...,n-l, 

2=1 2—1 

n n 

(23) li) = y 

i=l i=l 

where and bj are the elements of a and b sorted in decreasing order. 


Definition 9. Given two probability distributions p := {pi}^i and r := 
such that p A r, we shall say that an entropy S is Schur concave if S[ p] > 5[r]. 


The following result holds. 


Theorem 3. Assuming the hypotheses of Remark 5, the Zq, a ~entropy is Schur 
concave for a > 1. 

Proof. Since, according to Definition [8] and our hypotheses, any entropy of the class 
m is permutation invariant in the variables (pi,... ,pw) and its first derivatives 
exist, we shall use the Schur-Ostrowski criterion for Schur concavity |32]. Precisely, 
we have to prove that, for any probability distribution p, 

< 24 > 

The previous relation is indeed equivalent to the following inequality: 

(25) ( Pi - Pj ) ln' G ^ pf'j (p“- 1 -PT l )<^ 1 

which holds due to the properties of ln G . □ 


8. A TOWER OF NEW ENTROPIC FORMS 


The previous construction allows us to establish a correspondence among trace- 
form and non-trace-form entropies. Precisely, given a well-defined trace-form en¬ 
tropy, weakly composable , we can associate with it a new, non-trace-form but strictly 
composable, generalized entropy. In this way, we can generate a tower of new exam¬ 
ples of group entropies that parallel the well-known entropies, with infinitely many 
more in addition. 

As we have clarified, both the entropies of Boltzmann and Renyi correspond to 
the additive formal group. Let us consider the first example of nonadditive entropic 
function of the Z-class m, naturally associated with the multiplicative group law. 


Definition 10. We shall call the function 


(26) 


7 _ 

^q^ot — 


ln 9 (EZi Pi) 

1 — a 


the Zq^-entropy. Here q>0,0<a<l and ln q (x) is given by eq. m- 
The composition law for the entropy (|26l) is 

Zq,ot(A U B) = Z q ^ a (A) + Z q a (B) + (1 — Q:)(l — q)Zq ta (A)Zq^ a (B). 

The entropy (12611 . after a re-scaling of the parameters q 7 a, coincides with the 
Sharma-Mittal entropy (33]. 
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A new example can be obtained from the group law 


k 2 


\{x, y, k) = x\/l + k 2 y 2 + y\J 1 + k 2 x 2 = x + y + — {xy 2 + x 2 y )-— (xy 4 + x 4 y) + 

2 o 

+ higher order terms. 

The associated logarithm is the Kaniadakis logarithm [34], defined by 


(27) 


K (x) ■= 


x k - x~ k 


2k 


with — 1 < /c < 1. A new element of the Z-family is therefore the following entropy. 

Definition 11. The function 


(28) 


Z k ,a(Pl, ■ ■ ■ ,Pw) ■ = 


(TZiP?) k ~ (eT=iPj) 


-k 


2k (1 - a) 

will be called the Zk, a -entropy, with 0 < a < 1, — 1 < k < 1. 

The strict composability of the entropy (l28l) can be directly ascertained from the 
formula 

Z k , a (AuB) = Z k , a (A)^l + k 2 ( 1 - a) 2 Z k , a (BY+Z Ka {B)^l + k 2 { 1 - a) 2 Z k , a (A) 2 . 


This procedure can be easily extended to infinitely many group laws; correspond¬ 
ingly, it yields a sequence of entropic forms. Another particularly interesting case 
will be discussed below. 


9. The Z a ^-entropy : A generalization of the Boltzmann, Tsallis, 
Renyi, Sharma-Mittal entropies 

9.1. Definition. In this section, we present a first example of a composable, three- 
parametric entropy. Perhaps the most appealing feature of this entropy is that it 
generalizes some of the most important entropies known in the literature, which 
have played a prominent role in information theory, thermodynamics and generally 
speaking in applied mathematics. 


Definition 12. The Z a ^-entropy is defined to be the function 

(x£iP?)“-(e£iP?) 6 


(29) 


Z a ,b(pi, ■ ■ ■,PW) '■= 


(■a — b)( 1 — a ) 

with 0 < a < 1, and a > 0, b £ R or a € R, b > 0, with a ^ b. 


9.2. Limiting properties. The Z a ^-e ntropy reduces to the Boltzmann entropy in 
the limit a —> 1. We also have the following notable properties. 


Proposition 6. The Z a ^ entropy reduces to the Renyi entropy in the double limit 
a -A 0, b —> 0. 

Proposition 7. The Z a j, entropy reduces to the Tsallis entropy in the double limit 
b —> 0, a —> 1. 
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Proof. 


lim 


lim 
b-¥ o 


(EwK? 


(sj..*)Y_ (s." Y- 1 i 


~eZi p° 


(a — b)( 1 — a) 


= lim 

a—>1 a(l — a) 


a — 1 


which is the expression of the Tsallis entropy, as a function of the parameter a. 
Proposition 8. The Z a ^-entropy reduces to the Z^^-entropy in the limit a 


—b = k. 


□ 


Proposition 9. The Z a ^-entropy reduces to the Sharma-Mittal entropy in the limit 
fc-tO. 


9.3. Group-theoretical structure: the Abel formal group laws. The Z a ,fa- 

entropy is related to the Borges-Roditi logarithm: 


\n B R(x) := 


x — x 
a — b 


If we put x = e“, we recover the function known in the mathematical literature as 
the Abel exponential, given by 

g au _ g bu g7u / \ 

(30) exp Abei = a b = -j= sinh (VSuJ , 

where 7 = (a + b)/ 2, S = (a — b) 2 / 4. The Abel exponential (l30l) satisfies the Abel 
functional equation, as was proven in |35j . The composition laws associated are 
remarkable: the Abel formal group laws, defined by 


(31) Xa(x, y)=x + y + Pixy + ^ ft {xy l - x l y) . 

j>i 

The coefficients /3 n in m can be expressed as polynomials in a and b (see corollary 
2.2 of [37]): 

/fin—1 i r 

(32) ft=a + fc, Pn = —r, -TV TT (ia + jb), n > 1. 

n\{n — 1 x x 

V 1 i+j = n- 1 

i,j> 0 

The ring over which the universal Abel formal group law is defined has been studied 
in [36] I3Z]; the cohomology theory associated with this formal group law has been 
studied in [36} and in [38] . 


10. Quantum Z-entropies 

The class of Z-entropies can be quantized by means of a standard procedure. Pre¬ 
cisely, let us consider a quantum system, whose states belong to a finite-dimensional 
Hilbert space, and are represented by semi-positive definite density matrices p (see, 
e.g., [39], [40]). 


Definition 13. The family of quantum Z-entropies is defined by the formal relation 


(33) 


Zo,a(Pl, ■ ■ ■ ,Pw) 


ln G (trp a ) 
1 — a 


where a > 0 , a ^ 1 and ln G is a generalized group logarithm. 
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For each specific entropy, the set of parameters appearing in eq. (1551) are sup¬ 
posed to satisfy suitable constraints and, if necessary, certain conventions are tacitly 
adopted (as OlnO = 0 in the case of von Neumann entropy); however, we will not 
treat in detail these issues here. 

We shall discuss now the example of the quantum version of the Z a ^-entropy. 
Similar considerations apply to other cases. 


Definition 14. 

(34) 


lhe quantum Zj a ^-entropy is defined 

( trp a ) a - ( trp a ) b 

z a,b[P\ = -rry;-s~ 

(a — o)(l — a) 


One of the most interesting aspects of the family of quantum entropies (1551) is 
that they are directly related to the von Neumann entropy Svn = —trplnp and 
to the quantum Renyi entropy S a (p) = yi - Intrp Q . Concerning the quantum Z a ^- 
entropy, it possesses other interesting limits. For instance, it can be related to the 
quantum version of the Sliarma-Mittal entropy 


(35) 


Z a,o[_P\ 


(tr p a ) a - 1 
a(l — a) 


and leads to a two-parametric generalization of Kaniadakis entropy 

(tr p a ) k — (trp a ) -fc 


(36) 


Zk-k[p\ = 


2fc(l — a) 


Consider now the example of a quantum system whose Hilbert space is the tensor 
product Ha xHb of two of its subsystems A and B. For instance, we can consider 
a quantum spin chain of N spins, and a block of L sites (1 < L < N — 1). Therefore, 
we can identify Ha x Hb with the Hilbert spaces of the first L and N — L spins. 
Given the ground state \tp) of the chain, we can introduce the reduced density 
matrix p l = tr jv— i|'0) ('01, where trjv-z, denotes the trace over the Hilbert space 
of the remaining N — L sites. Thus, the previous formulae can be immediately 
written in terms of the reduced density matrix p l to define bipartite entanglement 
entropies for the considered spin chain. 

A priori, due to the multi-parametric nature of these entropies, they can be 
particularly useful in the study of entangled systems. In this perspective, we believe 
that Z a ^[p\ deserves special attention. An analysis of this aspect is outside the scope 
of the present paper, and will be discussed elsewhere. 


10.1. Applications: the generalized isotropic Lipkin-Meshkov-Glick model 

As an example of application of the entropic forms presented in the previous sec¬ 
tions, we shall consider the generalized isotropic Lipkin-Meshkov-Glick model of N 
interacting particles introduced in m- Its Hamiltonian reads 

m 

h = j 2 ha (i - Sij) + J2 c k ( Jk - Nh fc) 2 > 

i<j fc=1 

where hij,Ck > 0, hk £ M and J k = J*, 1 < k < m. Here J k (k = 1, . .. ,m) 

are operators whose action on the i-th site is jf = T kk — T™ +1,m+1 . where T pq is 
the (m + 1) x (m + 1) matrix whose only nonzero element is a 1 in the p- th row 
and <?-th column. The non-degenerate ground state of the model is a Dicke state 
of su(m + 1) type. 
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The ground state entanglement entropies for this model can be easily computed 
in the case of our group entropies, starting from the results of [27] . There, the 
reduced density matrix for a block of L spins was computed, when the system is in 
its ground state. In the large L limit, we obtain the formulae 


(37) Z a . 0 [p\ 

(38) 


a 2 


27rL(l- 7 )nr=Tn 


+ 1 1/ r 




- 1 


i(l — a) 




i(l — a)c 


ra +1 


2ti-( 1 - 7) IJ 


1/m 


3 =1 




0 ( 1 ), 


where a is the entropic parameter, 7 = limjv^oo A, rij are magnon densities (see 
m for details). The relevance of formula (l38l) for Z a ,o\p] is due to the fact that it 
solves an open problem proposed in [27]. Indeed, the quantum Renyi entropy is not 
extensive, i.e. proportional to L. The quantum Tsallis entropy is extensive, but 
for 777 > 3 only. Observe that, instead, the entropy Z a , 0 can be made linear in L. 
Indeed, we see immediately that the extensivity requirement implies a = 1 — . 

which is satisfied for any m, for suitable values of a. 


11. Open problems and future perspectives 

The present work represents a first exploration of the mathematical properties 
of a new, large family of non-trace-form group entropies coming from formal group 
theory via the composability axiom. The underlying group-theoretical structure is 
responsible for essentially all the relevant properties of this family. 

The results obtained above suggest that the Z-class can be a flexible tool, offering 
in a future perspective new insight into different contexts of the theory of classical 
and quantum complex systems, in ecology and social sciences. For instance, we plan 
to define generalized diversity indices related to the class. Also, Z-entropies are 
particularly suitable for defining new divergences, generalizing those of Renyi m 
and Kullback-Leibler [52] and are potentially relevant in the context of information 
geometry [43] . 

A directly related expression for Z-entropies is given by the formula 
(39) S\p] := G • 

Although very similar to the main definition of Z-entropies proposed in Definition 
0 the class (l39l) deserves attention for its statistical properties, and will be analyzed 
elsewhere. 

We wish to point out that some of the definitions of the theory can be reformu¬ 
lated in different ways, and some conditions can be relaxed. The present approach 
has the advantage of providing a large class of group entropies in a simple way; 
however, the problem of determining the most general form for group entropies is 
open. We shall discuss in detail recent progress on these issues elsewhere. 

In our opinion, the crucial role played by the group-theoretical approach in the 
description of compound systems paves the way towards a re-foundation of the 
theory of generalized entropies in terms of group entropies. 

An open problem is to establish whether the Z-entropies are Lesche stable. We 
conjecture that, in this respect, the entropies of the class m have essentially the 
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same behaviour as the Renyi entropy. As was proved in [44]. from many respects, 
Renyi’s entropy can also be considered an observable. This conjecture will be 
thoroughly analyzed in a future work. 

We also wish to mention that a generalization of the correspondence among 
entropies and zeta functions mmm to the case of multi-parametric entropies 
and multiple zeta values and polylogarithms is an interesting open problem. 

Appendix A. The Shannon-Khinchin axioms 

As customary in the literature on generalized entropies, here we re-state the 
original requirements of Shannon and Khinchin for an entropy to be admissible, in 
terms of four requirements. 

(SKI) (Continuity). The function S(p i,... ,pw) is continuous with respect to 
all its arguments. 

(SK2) (Maximum principle). The function S(pi,... ,pw) takes its maximum 
value over the uniform distribution pi = 1/W, i = 1,... ,W. 

(SK3) (Expansibility). Adding an event of zero probability to a probability 
distribution does not change entropy: S(p±,... ,pw, 0) = S(pi,... ,Pw)- 

(SK4) (Additivity). Given two subsystems A, B of a statistical system, 

S(A U B) = S{A) + S(B | A). 
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